Combining Trust Region and Line Search Techniques
نویسنده
چکیده
We propose an algorithm for nonlinear optimization that employs both trust region techniques and line searches Unlike traditional trust region methods our algorithm does not resolve the subproblem if the trial step results in an increase in the objective function but instead performs a backtracking line search from the failed point Backtracking can be done along a straight line or along a curved path We show that the new algorithm preserves the strong convergence properties of trust region methods Numerical results are also presented
منابع مشابه
روش به روز رسانی متقارن از مرتبه اول برای حل مسایل بهینه سازی مقیاس بزرگ
The search for finding the local minimization in unconstrained optimization problems and a fixed point of the gradient system of ordinary differential equations are two close problems. Limited-memory algorithms are widely used to solve large-scale problems, while Rang Kuta's methods are also used to solve numerical differential equations. In this paper, using the concept of sub-space method and...
متن کاملOn efficiently combining limited-memory and trust-region techniques
Limited memory quasi-Newton methods and trust-region methods represent two efficient approaches used for solving unconstrained optimization problems. A straightforward combination of them deteriorates the efficiency of the former approach, especially in the case of large-scale problems. For this reason, the limited memory methods are usually combined with a line search. We show how to efficient...
متن کاملTrust Region versus Line Search for Computing the Optical Flow
We consider the numerical treatment of the optical flow problem by evaluating the performance of the trust region method versus the line search method. To the best of our knowledge, the trust region method is studied here for the first time for variational optical flow computation. Four different optical flow models are used to test the performance of the proposed algorithm combining linear and...
متن کاملFrom Line Search Method to Trust Region Method
Line search method and trust region method are two important classes of techniques for solving optimization problems and have their advantages respectively. In this paper we use the Armijo line search rule in a more accurate way and propose a new line search method for unconstrained optimization problems. Global convergence and convergence rate of the new method are analyzed under mild conditio...
متن کاملSQP methods for large - scalenonlinear programmingby
We compare and contrast a number of recent sequential quadratic programming (SQP) methods that have been proposed for the solution of large-scale nonlinear programming problems. Both line-search and trust-region approaches are considered, as are the implications of interior-point and quadratic programming methods.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1998